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Abstract 

In this paper, we prove the necessary and sufficient maximum principles (NSMPs 
in short) for the optimal control of systems described by a quasilinear stochastic heat 
equation within convex control domains, which all the coefficients contain control vari- 
ables. For that, the optimal control problem of fully coupled forward- backward doubly 
stochastic system is studied. We apply our NSMPs to treat a kind of forward-backward 
doubly stochastic linear quadratic optimal control problems and an example of optimal 
control of stochastic partial differential equations (SPDEs in short) as well. 

Key words: Maximum principle, forward-backward doubly stochastic differential equa- 
tion, convex perturbation, stochastic partial differential equation, Malliavin calculus. 

1 Introduction 

In order to provide a probabilistic interpretation for the solutions of a class of quasilinear 
stochastic partial differential equations (SPDEs in short), Pardoux and Peng [14] introduced 
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the following backward doubly stochastic differential equation (BDSDE in short): 

Y t = £ + ^ f(s,Y s ,Z s )ds 

+ J g{s,Y s ,Z s )dB~ s - J Z s d^s,- 

(1.1) 

Note that the integral with respect to {B t } is a "backward ltd integral" and the integral 
with respect to {W t } is a standard forward ltd integral. These two types of integrals are 
particular cases of the Ito-Skorohod integral (for more details see [10] and [14]). Pardoux 
and Peng [14] have obtained the relationship between BDSDEs and a certain quasilinear 
stochastic partial differential equations (SPDEs in short). More precisely 



u (t, x) — ip (x) + [Cu (s, x) + f (s, x, u (s, x) , (Vua) (s, x))] ds 
+ g (s, x, u (s, x) , (Vua) (s, xj) dB s , < t < T, 



where u : [0, T] x H d — >■ H k where d, k G N, and V« (s, x) denotes the first order derivative 
of u (s, x) with respect to x, and 

/ Lu x \ 

Cu = \ , 
\ Lu k J 



with 



x 



»J=1 



d 2 (j) (x) 
dxidxj 



(x) 



i=l 



dxi 



(for more details see [14]). 

In 2003, Peng and Shi [17] introduced a type of time-symmetric forward-backward stochas- 
tic differential equations, i.e., so-called fully coupled forward-backward doubly stochastic 
differential equations (FBDSDE in short): 

Vt = x + f* f (s,y s ,Y s ,z s ,Z s )ds + g(s,y s ,Y s ,z s ,Z s )dW^ s - f^sd^B,,, 
Y t = (p(y T ) + ff r F(s,y s ,Y s ,z s ,Z s )ds + f^G(s,y s ,Y s ,z s ,Z s )dB s + ffZ s dwi. 

(1-2) 

In FBDSDEs (1.2), the forward equation is "forward" with respect to a standard stochastic 
integral dWj, as well as "backward" with respect to a backward stochastic integral d% the 
coupled "backward equation" is "forward" under the backward stochastic integral dB~ t and 
"backward" under the forward one. In other words, both the forward equation and the 
backward one are types of BDSDE (1.1) with different directions of stochastic integrals. 
So (1.2) provides a very general framework of fully coupled forward-backward stochastic 
systems. Peng and Shi [17] proved the existence and uniqueness of solutions to FBDSDE 
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(1.2) with arbitrarily fixed time duration under some monotone assumptions. FBDSDE (1.2) 
can provide a probabilistic interpretation for the solutions of a general class of quasilinear 
SPDEs. 

In this paper, we consider the following quasilinear SPDEs with control variable: 

u (t, x) = <p (x) + | ( T [C"u (s, x) + F (s, x, u (s, x) , (Vug) (s, x, u) , v (s))] ds 
+ f*G(s,x,u(s,x),(Vug)(s,x,u),v(s))dB s , 0<t<T, 

where u : [0, T] x R d — > R fe and Vw (s, x) denotes the first order derivative of u (s, x) with 
respect to x, and 

/ L v m 

Cu = 

with 



V L v u k 



V* (*) = \ t (99% (*, u,v) d ^ + ± fl (x, u, v) »+ {X) 



2 ^ 13 ' dxidxj ^ dxi 
i,j=i J t=i 

It is worth to pointing out that all the coefficients contain the control variable. (For more 
details see Section 5). 

Let us describe the problem solved in this paper. Set U a d be an admissible control set. 
The definitions of notations used here can be found in Section 2. The optimal control problem 
of SPDEs (1.3) is to find an optimal control v* (•) G U a d, such that 

J («*(•))= inf J («(•)), 

v{-)&A ad 



where J (■) is its cost function as follows: 



J(v(-)) = E 



/ / (s, x, u (s, x) , (Vm<j) (s, x, u) , v (s)) ds + 7 (u (0, x)) 
Jo 



(1.4) 



As we have known, stochastic control problem of the SPDEs arising from partial observa- 
tion control has been studied by Mortensen [9] , using a dynamic programming approach, and 
subsequently by Bensoussan [2], [3], using a maximum principle method. See [4], [15] and the 
references therein for more information. Our approach differs from the one of Bensoussan. 
More precisely, we relate the FBDSDE to one kind of SPDEs with control variables where the 
control systems of SPDEs can be transformed to the relevant control systems of FBDSDE. 
To our knowledge, this is the first time to treat the optimal control problems of SPDEs from 
a new perspective of FBDSDE. It is worth mentioning that the quasilinear SPDEs in [12] 
0ksendal considered can just be related to our partially coupled FBDSDE. Recently, Zhang 
and Shi [25], obtained the similar results, however, in their paper, the coefficients a and g 
do not contain the control variable, respectively. 

This paper is organized as follows. Section 2 is devoting to stating the problems and 
some assumptions. In Section 3 and Section 4, we give the necessary and sufficient maximum 
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principles for fully couple forward-backward doubly stochastic control systems, respectively, 
in global form. As an application, we study the optimal control of SPDEs in Section 5. 
For simplicity of notations, we consider the one-dimensional case. It is necessary to point 
out that all the results can be extended to multi-dimensional cases. Finally, in Section 6 
our results are further illustrated by solving optimal controls of LQ problem and a special 
SPDEs using the Malliavin calculus, respectively. 



2 Statement of the problems 



Let (f^J 7 , P) be a completed probability space, {W t } t>0 and {B t } t>0 be two mutually 
independent standard Brownian motions, with value respectively in R d and R/, defined on 
(Q, fF , P). Let Af denote the class of P-null sets of fF . For each t G [0, T] , we define 



Tf = a {W r ; < r < t} \J Af, F t B T = a {B r - B t ; t<r<T}\jAf, 



and 



T t = lf \/F t B T , Vte[0,T}. 



Note that { F^; t G [0,T]} is an increasing filtration and {F B T ;t G [0,T]} is a decreasing 
filtration, and the collection {Ft,t G [0,T]} is neither increasing nor decreasing. 

We denote M 2 (0,T;R n ) the space of (class of dP ® dt a.e equal) all {.Ft }- measurable 



Ef T \v(s)\ 2 ds 



< oo. Obviously 

2 



n-dimensional processes v with norm of || v \\m- 

M 2 (0, T; R n ) is a Hilbert space. For any given u G M 2 (0, T. R n ) and v G M 2 (0, T ; R n ) , 
one can define the (standard) forward Ito's integral J Q u s dW s and backward Ito's integral 

J T v s dB~ s . They are both in M 2 (0, T; R n ) , (see [14] for details). 

Let L 2 (fl, Ft, P; R n ) denote the space of all {J^j-measurable R n -valued random variable 
£ satisfying E |£| 2 < oo. 

Definition 1. A stochastic process X = {X t ;t>0} is called Ft-progressively measur- 
able, if for any t > 0, X on Q x [0,t] is measurable with respect to {fFY x ^([0,t])) V 
(T t B T xB([t,T})). 

For simplicity of notations, hereafter we consider the one-dimensional case. In the present 
paper all the results can be extended to multi-dimensional cases. Under this framework, we 
consider the following forward-backward doubly stochastic control system 

f dy(t) = f(t,y(t),Y(t),z(t),Z(t),v(t))dt 

+g (t, y(t),Y (t) ,z(t),Z(t),v (t)) dW t - z (t) d%, 
dY {t) = -F (t, y(t),Y (t) ,z(t),Z(t),v (t)) dt (2.1) 

-G (t, y(t),Y (t) ,z(t),Z(t),v (t)) dF7 t + Z (t) dV^ t , 
y(0)=x , Y(T) = tp(y(T)), 
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where (y (t) ,Y (t) , z (t) , Z (t) , v (t)) GRxRxRxRxR, rr G R, is a given constant, 
t > and T > 0, 

F : [0,T]xRxRxRxRxR ->• R, 
/: [0,T]xRxRxRxRxR ->• R, 
G: [0,T]xRxRxRxRxR ->■ R, 
5: [0,T]xRxRxRxRxR ->■ R, 
ip : R ->■ R. 

Let U he a nonempty convex subset of R. We define the admissible control set 

U ad = {v(-) e M 2 (0,T;R); v(t)eU, < t < T, a.e., a.s.} . 
Our optimal control problem is to minimize the cost function: 



J(v(-)) = E 
over U a d, where 



/ (t, y(t),Y (t) ,z(t),Z(t),v (t)) dt + $(y (T)) + 7 (Y (0)) 



(2.2) 



I 

$ 
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[0, T] x R x R x R x R x R ->• R, 
R ->■ R, 
R ->■ R. 



An admissible control u (•) is called an optimal control if it attains the minimum over U a d- 
That is to say, we want to find a u (•) , such that 

J («(•))= inf J( V (.)). 

v(-)eu ad 

(2.1) is called the state equation, the solution (y (•) , F (•) , 2; (•) , Z (•)) corresponding to u (•) 
is called the optimal trajectory. Next we will give some notations: 



/ y \ 

Y 

z 



A (t, C) 



/ -F\ 

f 

-G 
\ 9 J 



(U) 



We use the usual inner product (•,•) and Euclidean norm |-| in R, R, and R d . All the 
equalities and inequalities mentioned in this paper are in the sense of dt <8> dP almost surely 
on [0,T] x Q. We assume that 



(HI) 



For each £ e R 1+1+1+1 , A(-,() is an J^-measurable process defined on [0,T] 
with A(-,0) E M 2 (0, T; R 1+1+1+1 ) . 



(H2) A (t, C) and <p (y) satisfy Lipschitz conditions: there exists a constant k > 0, such that 
\A(tX)-A(tX)\<k\(-(\, VC, CeR 1+1+1+1 , VtG[0,T], 

< k \y-y\ , Vy,yeR. 
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The following monotonic conditions introduced in [17], are the main assumptions in this 
paper. 

r (A(tx)-A(tx),c-c)<-»\(-(\ 2 , 

(H3) I V{ = (y,Y,z,Zf, C= (y,Y, z,Z) T ERxRxRxR, Wg[0,T]. 
I (y) - v (y) , 2/ - y) > 0, Vy, ye R. 



or 



<A(t,c)-A(t,c),c-C>>^|C-C 
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(H'3) \ \/(=(y,Y,z,Z) T , (= (y,Y,z,Z) T ERxRxRxR, Wg[0,T]. 

(y) - v (y) > y - y> < °> v y> y e R ^ 

where // is some positive constant. 

Proposition 2. For any given admissible control v (•) , we assume (HI), (H2) and (H3) (or 
(HI ), (H2) and (H3) ') hold. Then FBDSDE (2. 1 ) has the unique solution (y (•) , Y (•) , z (•) , Z i 
M 2 (0,T; R 1+1+1+1 ). 

The proof of Proposition 2 can be seen in [17] and [26]. We assume: 

i) F, /, G, g, ip, I, $, 7 are continuously differentiable 
with respect to (y, Y, z, Z, v) , y and Y; 

ii) The derivatives of F, /, G, g, <p are bounded; 

iii) The derivatives of I are bounded by C (1 + |y| + |Y| + \z\ + \Z\ + \v\) ; 

iv) The derivatives of $ and 7 with respect to y, Y are bounded by 
C (1 + \y\) and C (1 + \Y\) , respectively. 



(H4) { 



Lastly we need the following extension of Ito's formula (for more details see [14]). 

Proposition 3. Let a e S 2 ([0,T];R k ) , f3 G M 2 ([0, T}; R k ) , 7 G M 2 ([0 , T]; R kxl ) , 5 G 
S 2 ([0, T];R kxd ) satisfy: a t = a + /„* (5 s ds + /„* -f s dB s + £ 5 s dV^, < t < T. Then 



\a t \ 2 = \a \ 2 + 2 (a s ,p s ) ds + 2 (a s , 7 s c?£) + 2 jf (a a ,<y a dwT 

- / |7 S | 2 + / |5 S | 2 ds, 

E|a t | 2 = E|a | 2 + 2E / (a s ,p s )ds-E \ ls \ 2 ds + E \5 S \ 2 ds. 

Jo Jo Jo 

More generally, if <p G C 2 (R k ) , 

<P (a t ) = <j) (a ) + J (0' (a s ) , ^ ds + J (a s ) , 7s dlQ + J (a s ) , 5 s dV^ 



-\s> 



ds. 
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Here S 2 (0,T;R fe ) denotes the space of (classes of dt <8> dP a.e. equal) all ^-progressively 
measurable A;-dimensional processes v with 



E sup \v{t)\ 2 < oo. 

\0<i<T / 



3 A necessary maximum principle for optimal controls of 
forward- backward doubly stochastic control systems 

We consider the forward-backward doubly stochastic control system (2.1) and the cost 
function (2.2). Let u(-) be an optimal control and (y (•) , Y (•) , z (•) , Z (•)) be the corre- 
sponding trajectory. Let v (•) be any given admissible control such that u (•) + v (•) G U a d- 
Since U ac [ is convex, then for any < p < 1, u p (•) = u (•) + pv (■) is also in U a d- 

We introduce the following variational equation of FBDSDE (2.1): 

f dy 1 (t) = [f y (t, y(t),Y (t) ,z(t),Z(t),u (t)) y 1 (t) 
+f Y (t,y(t),Y(t),z(t),Z(t),u(t))Y^t) 
+f z (t,y(t),Y(t),z(t),Z(t),u(t))z 1 (t) 
+f z (t,y(t),Y(t),z(t),Z(t),u(t))Z l (t) 
+f v (t, y(t),Y (t) ,z(t),Z(t),u (*)) v (t)]dt 
+[g y (t, y(t),Y (t) ,z(t),Z(t),u (t)) y 1 (t) 
+g Y (t,y(t),Y(t),z(t),Z(t),u(t))Y 1 (t) 
+g z (t, y(t),Y (t) ,z(t),Z(t),u (t)) z 1 (t) 
+g z (t,y(t) ,Y (t) ,z(t) ,Z (t) ,u(t)) Z 1 (t) 

+g v (t, y(t),Y (t) ,z(t),Z(t),u (t)) v (t)]dW t - z 1 (t) dB u 
< dY 1 (t) = -[F y (t, y(t),Y (t) ,z(t),Z(t),u (t)) y 1 (t) (3.1) 
+F Y (t,y(t),Y(t),z(t),Z(t),u(t))Y 1 (t) 
+F z (t,y(t),Y(t),z(t),Z(t),u(t))z 1 (t) 
+F z (t,y(t),Y(t),z(t),Z(t),u(t))Z 1 (t) 
+F v (t,y(t),Y(t),z(t),Z(t),u(t))v(t)]dt 
-[G y (t,y(t),Y(t),z(t),Z(t),u(t)) y '(t) 
+G Y (t,y(t),Y(t),z(t),Z(t),u(t))Y 1 (t) 
+G z (t,y(t),Y(t),z(t),Z(t),u(t))z 1 (t) 
+G z (t,y(t),Y(t),z(t),Z(t),u(t))Z 1 (t) 
+G V (t, y(t),Y (t) ,z(t),Z(t),u (f)) v (t)]dB t + Z 1 (t) dW t , 
^ y 1 (0) = 0, (t) = Vy (y (T)) y 1 (T) . 

From (H3), (H4) and Proposition 2, it is easy to check that (3.1) satisfies (HI), (H2) and (H3). 
Then there exists a unique quadruple of (y 1 (t) , Y 1 (t) , z 1 (t) , Z l (t)) in M 2 (0, T) satisfying 
FBDSDE (3.1). We denote by (y p (t) , Y p (t) , z p (t) , Z p (*)) the trajectory of FBDSDE (2.1) 
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corresponding to u p (•) as follows. 

' dy p (t) = f (t, y p (t) , Y p (t) , z p (t) , Z p (t) , u p (*)) dt 

+g (t, y p (t) , Y p (t) , z p (t) , Z p (t) , u p (t)) dW t - z p (t) d%, 
dY p (t) = -F (t, y p (t) , Y p (t) , z p (t) , Z p (t) ,u p (t))dt 

-G (t, y p (t) , Y p (t) , z p (t) , Z p (t) , u p (t)) d% + Z p (t) dW u 
( y p (0)=x , Y p (T) = <p(y p (T)), 

Then we will study the solutions to forward-backward doubly stochastic control systems 
with parameter. 

Lemma 4. Assume that (H1)-(H4) hold. Then we have 



y P (t)-y(t) 



lim 



lim 

p->0 



1 p 




y P (t) - 


Y(t) 


p 




1 z P (t) - 


■z(t) 


o p 




z P (t) - 


Z(t) 



p 



y 1 (t) , 

Y 1 (*) , 
z 1 (t) , 



where the limits are in M 2 (0,T). 



Proof. Firstly, we show the continuous dependence of solutions with respect to the parameter 
p. Let 



y(t) = y P (t)-y(t), 

Y(t) = Y p (t)-Y(t), 

z(t) = z p (t)-z(t), 

Z(t) = Z p (t)-Z(t). 
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We have 



' dy (t) = [f(t, y p (t) , Y p (t) , z p (t) , Z p (t) ,u{t) + pv (t)) 
-f(t,y p (t),Y p (t),z p (t),Z p (t),u(t)) 
+f(t,y p (t),Y p (t),z p (t),Z p (t),u(t)) 
-f(t,y(t),Y(t),z(t),Z(t),u(t))]dt 
+[g(t, y p (t) , Y p (t) , z p (t) , Z p (t) ,u(t) + pv (t)) 
-g(t,y p (t),Y p (t),z p (t),Z p (t),u(t)) 
+g(t,y p (t),Y p (t),z p (t),Z p (t),u(t))_ 

-g(t, y(t),Y (t) ,z(t),Z(t),u (t))]dW? - z (t) d%, 
< dY (t) = -[F(t,y p (t) , Y p (t) , z p (t) , Z p (t) ,u(t) + pv (t) ) 
-F(t,y p (t) ,Y p (t) ,z p (t) ,Z p (t) ,u(t)) 
+F(t,y p (t),Y p (t),z p (t),Z p (t),u(t)) 
-F(t,y(t),Y(t),z(t),Z(t),u(t))]dt 
-[G(t, y p (t) , Y p (t) , z p (t) , Z p (t) ,u(t) + pv (t)) 
-G(t,y p (t) ,Y p (t) ,z p {t) ,Z p {t) ,u{t)) 
+G(t,y p (t),Y p (t),z p (t),Z p (t),u(t)) 
-G(t, y(t),Y (t) ,z(t),Z(t),u (t))]d% + Z (t) dW u 
U(0) = 0, Y(T) = <p(y p (T))-tp(y(T)). 



We will prove [y (t) ,Y(t),z(t),Z (t)) converge to in M 2 (0, T) as p ->■ 0. Applying Ito's 
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formula to ( y (t) , Y (t)J on [0, T] , and by (H4) it follows that 

E(y{T), V {y p {T))-y{y{T))) 

[ {A(t,£ p )-A(t,Z),Z P -Odt 
Jo 



where 



E 



Thus we get 
E 



T 



-E / y (t) [F (t, y p (t) , Y p (t) , z p (t) , Z p (t) ,u(t) + pv (t)) 
Jo 

-F (t, y p (t) , Y p (t) , z p (t) , Z p (t) , u (t))]dt 

+E f Y (t) [f (t, y p (t) , Y p (t) , z p (t) , Z p (t) ,u(t) + pv (t)) 
Jo 

-f (t, y p (t) , Y p (t) , z p (t) , Z p (t) , u (t))]dt 

-E / z (t) [G (t, y p (t) , Y p (t) , z p (t) , Z p (t) ,u(t) + pv (t)) 
Jo 

-G (t, y p (t) , Y p (t) , z p (t) , Z p (t) , u (t))]dt 



+E / Z (t) [g (t, y p (t) , Y p (t) , z p (t) , Z p (t) ,u(t) + pv (t)) 



-g (t,y p {t) ,Y p (t) ,z p (t) ,Z p (t) ,u(t))]dt 



< -fiE 



\y{t)\ 2 + Y(t) + \z(t)\ 2 + Z{t) 



\y(t)\< + Y(t) +\z(t)r+ Z(t) 

+-p 2 CE [ \v(t)\ 2 dt, 
^ Jo 



dt 
dt 



at) 

A (t, o 



(y p (t) ,Y p (t) ,z p (t) ,Z p (t) ,u(t)f , 
(y(t),Y(t),z(t),Z(t),u(t)) T , 



( ~F(t,0 \ 




( -F (t, £p) \ 




, A(t,£ p ) = 


f (*, C) 




-G(t,Q 


\ g(t,0 ) 







\y{t)\ 2 + Y(t) +\z(t)\ 2 + Z{t) 



dt < p 2 CE 



[ T \v(t)f 
Jo 



dt. 
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y P (t) - 


y(t) 


p 




Y P (t) - 


Y(t) 


P 




z P (t)- 


z(t) 


P 




z P (t) - 


Z(t) 



Then it follows that yy (t) ,Y (t) , z (t) , Z (t) ) converge to in M 2 (0, T) as p tends to 0. Set 

Ay(t) - 
AY(t) - 

Az{t) -- 
AZ(t) -- 

P 

then 

dAy (t) = f^yp^^M^^pWM^+pvm-fitM^XWMt)^^)^)) ^ 
| g(t,y p (t)x P (t),z p (t),z p (t)Mt)+pv(t))-g(t,y(t)X(t)Xt),z(t)At)) d^ 

-Az(t) d%, 

-dAF ft) = i? ( f ^p( f )' y pW' z pW' z pW'"( f )+/ ot, ( f ))- F ( t ^( t )' r ft)' z ( t )^( f )' M W) ^ 

p J— 

| G(t,y p (t)Xp(t)Mt),Z P (t)Mt)+Mt))-G(t,y(t)X(t),z(t),Z(t)Mt)) ^^ 

-AZ(t)dW t , 
Ay(0)=0, Ay(T) = ^t«. 

The above equations can be expressed as follows 

dAy (t) = f (t, Ay (t) , AY (t) , Az (t) , AZ (t) ,v(t)) dt 
+g (t, Ay (t) , AY (t) , Az (t) , AZ (t) ,v(t)) dV^ t 
-Az(t)dB t , 

-dAY (t) = F (t, Ay (t) , AY (t) , Az (t) , AZ (t) , v (t)) dt 
+G (t, Ay (t) , AY (f) , Az (t) , AZ (t) , v (*)) d% 
-AZ(t) dV^ t , 
Ay(0) = 0, AY (T) = g^ZfaM) , 

where 6 — f, F, g, G, respectively, 

(t, Ay, Ay, Az, AZ, u) = A e (t) Ay + fi e (t) Ay + (t) Az + £>" (t) AZ + (i) u, 
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and 

A 9 (t) = 

B 9 (t) = 

C 9 (t) = 

D e it) = 

E e (t) = 



e(t,y p (t),Y P (t),z P (t),Z p (t),u(t)+pv(t))~9(t,y(t),Yp(t),z P (t),Z p (t),u(t)+pv(t)) 

y P (t)-y(t) 

0, otherwise; 

e(t,y(t),Y p (t),z p (t),Z p (t),u(t)+pv(t))-9(tMt),y(t),Zp(t),Z p (t),u(t)+p-v(t)) 

Y p (t)-Y(t) 

0, otherwise; 

e(t,y{t)X{t)Mt),Z P {t),u{t)+pv{t))-e{t,y(t),Y{t)Mt),Z p {t),u{t)+pv{t^ 

z p (t)-z(t) 

0, otherwise; 

Zp (t)-z(t) ' z pW" z W^ U ' 

0, otherwise; 

e(t,y(t),Y(t),z(t),Z(t),u(t)+pv(t))-e(t,y(t),Y(t),z(t),Z(t),u(t)) QV U\ ^ Q 

pv(t) ' r \ ) I 1 



, y p (t)-y(t)^0, 



, Y p (t)-Y(t)^0, 



z p (t)-z(t)^0, 



0, otherwise. 

From the continuous dependence of solutions with respect to the parameter p, it follows that 

\imA°(t) = 6 y (t,y(t),Y(t),z(t),Z(t),u(t)), 
p— >u 

limfl*(t) = 9 Y (t,y(t),Y(t),z(t),Z(t),u(t)), 
p— >o 



lim C° (t) 

p^0 

-.0 



9 Z (t,y(t),Y(t),z(t),Z(t),u(t)), 



KmD°(t) = 9 z (t,y(t),Y(t),z(t),Z(t),u(t)), 
\imE 9 (t) = e v (t,y(t),Y(t),z(t),Z(t),u(t)). 

p^O 

According to the continuous dependence of solutions with respect to the parameter and 
the uniqueness of solutions of FBDSDE (3.1), the solutions (Ay (t) , AY (t) , Az (t) , AZ (t)) 
converge to (y 1 (t) , Y l (t) , z 1 (t) , Z 1 (t)) in M 2 (0, T; R 1+1+1+1 ) as p ->■ 0. The proof is com- 
pleted. □ 

Now we give the variational inequality. 

Lemma 5. Assume that (H1)-(H4) hold. Then we have 

E$ y (y (T)) y 1 (T) + E 7y (Y (0)) Y 1 (0) 

+E [ [l y (t, y(t),Y (t) ,z(t),Z(t),u (*)) y 1 (t) 
Jo 

+l Y {t,y{t),Y{t),z{t),Z{t),u{t))Y l (t) 
+l z {t,y{t),Y{t),z{t),Z{t),u{t))z l (t) 
+l z {t,y(t),Y(t),z(t),Z(t),u(t))Z l (t) 
+l v (t, y(t),Y (t) ,z(t),Z(t),u (t)) v (t)]dt 

> 0. 
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Proof. From Lemma 4 and (H4), we can get 



and 



e [« (,,, m> -«(»(?))] = M , fem)w . m , 

lim E[ 7 (y p (Q))- 7 (y(o))] = ^ ^ 



p-S>0 



limp^E / [Z(t,^(t),y p (i),^(t),Z p (*),«(*) + /!«;(*)) 

-Z(t,y(t),y(t),z(*),Z(t),«(*))]dt 

/ \l y {t,y{t),Y{t),z{t),Z{t),u{t))y l (t) 
Jo 

+l Y {t,y{t),Y{t),z{t),Z{t),u{t))Y l (t) 
+l z (t^t)^*),^),^*),^))* 1 (t) 
+lz {t,y{i),Y{t),z{i),Z{t),u{t))Z l {t) 
+l v (t, y(t),Y (t) ,z(t),Z(t),u (t)) v (t)]dt. 



E 



On the other hand, since u (•) is an optimal control, it follows that 

p- 1 [J(u(.)+pv(.))-J(u(.))]>0. 

Therefore the desired result is obtained. □ 

Now we introduce the adjoint equation by virtue of dual technique and Hamilton func- 
tion for our problem. From the variational inequality obtained in Lemma 5, the maximum 
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principle can be proved by using Ito's formula. The adjoint equations are 



' dp (t) = [Fy (t, y(t),Y (t) ,z(t),Z(t),u (*)) p (t) 
-f Y (t,y(t),Y(t),z(t),Z(t),u(t))q(t) 
+G Y (t,y(t),Y(t),z(t),Z(t),u(t))k(t) 
-g Y (t,y(t),Y(t),z(t),Z(t),u(t))h(t) 
-l Y (t,y(t),Y(t),z(t),Z(t),u(t))]dt 
+ [F z (t,y(t),Y(t),z(t),Z(t),u(t))p(t) 
-f z (t,y(t),Y(t),z(t),Z(t),u(t))q(t) 
+G Z (t,y(t),Y(t),z(t),Z(t),u(t))k(t) 
-gz (t, y(t),Y (t) ,z(t),Z(t),u (*)) /i| 

-lz (t, y(t),Y (t) ,z(t),Z(t),u m<W ~ hdBt, 
< dq(t) = [F y (t,y(t),Y(t),z(t),Z(t),u(t))p(t) (3.2) 
-f y (t,y(t),Y(t),z(t),Z(t),u(t))q(t) 
+G y (t,y(t),Y(t),z(t),Z(t),u(t))k(t) 
-g y (t,y(t),Y(t),z(t),Z(t),u(t))h(t) 
-l y (t,y(t),Y(t),z(t),Z(t),u(t))]dt 
+[F g (t,y(t),Y(t),z(t),Z(t),u(t))p(t) 
-f z (t,y(t),Y(t),z(t),Z(t),u(t))q(t) 
+G z (t,y(t),Y(t),z(t),Z(t),u(t))k(t) 
-g z (t,y(t),Y(t),z(t),Z(t),u(t))hti) 

-l z (t, y(t),Y (t) ,z(t),Z(t),u (t))]d% + htdWt, 
p (0) = - lY (Y (0)) , q (T) = -<p y (y (T)) P (T) + % (y (T)) . 



It is easy to check that FBDSDE (3.2) satisfies (HI), (H2) and (H 3), so it has a unique 



H (t,y(t) ,Y (t) ,z(t) ,Z (t) ,v(t) ,p(t) ,q(t) ,k(t) ,h(t)) 
= (q(t) , f (t,y(t) ,Y (t) ,z(t) ,Z (t) ,v(t))) 
- (p(t) ,F (t,y(t) ,Y (t) ,z(t) ,Z (t) ,v(t))) 
-(k(t),G(t,y(t),Y(t),z(t),Z(t),v(t))) 
+ {h (t) ,g(t,y(t) ,Y (t) ,z(t) ,Z it) ,v(t))) 
+l(t,y(t),Y(t),z(t),Z(t),v(t)). 



solution (p (t) ,q(t),k(t),h (t)) G M 2 (0, T; R 1+1+1+1 ) . 



We define the Hamiltonian function H as follows: 



(3.3) 



FBDSDE (3.2) can be rewritten as 




(3.4) 
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where Hp = Hp (t, y (t) ,Y (t) ,z(t),Z(t),u (t) ,p(t),q(t),k (t) , h (*)) , f3 = y, Y, z, Z, re- 
spectively. At last, we can claim the first major result in this paper. 

Theorem 6. (Necessary maximum principle j Let u(-) be an optimal control and let 
(y(-) , Y (•) , z (•) , Z (■)) be the corresponding trajectory. Then we have 

(H v (t,y(t),Y(t),z(t),Z(t),u(t),p(t),q(t),k(t),h(t)),v-u(t)) > 0, 

a.e., a.s. t G [0, T] , Vi> G U, 

(3.5) 

where (p (t) ,q(t) ,k(t) ,h (£)) is the solution of the adjoint equation (3.2). 
Proof. Applying Ito's formula to (y 1 (t) , q (t)) + (Y 1 (t) ,p (t)) on [0, T] , we have 

E [(y 1 (T) ,q(T)) + (Y 1 (T) , p (T)> - (y 1 (0) , g (0)> - (Y 1 (0) , p (0))] 

+E / [l y (t, y(t),Y (t) ,z(t),Z(t),u (t)) y 1 (t) 
Jo 

+i Y (t, 2/ (t),y(t),z(t),z(t),«(t))y 1 (t) 

+l z {jb,y{t),Y{t),z{t),Z{t),u{fy)^ ® 
+lz (t,y(t) ,Y (t) ,z(t) ,Z (t) ,u(t)) Z 1 (t) 
+l v (t, y(t),Y (t) ,z(t),Z(t),u (t)) v (t)]dt 

= e[ [{q(t),f v (t,y(t),Y(t),z(t),Z(t),u(t))v(t)) 
Jo 

- (p(t) ,F v (t,y(t) ,Y (t) ,z(t) ,Z (t) ,u(t))v{t)) 

- (k (t) , G v (t, y(t),Y (t) ,z(t),Z(t),u (t)) v (t)) 
+ (h (t) , g v (t, y(t),Y (t) ,z(t),Z(t),u (*)) v (t)) 
+ (v (t) , l v (t, y(t),Y (t) ,z(t),Z(t),u (t)))]dt. 

From the variational inequality in Lemma 5 and noting (3.3), for any v (•) G ti a d such that 
u (•) + v (•) G U ad , we have 

E I (H v (t,y(t),Y{t),z(t),Z(t),u{t),p{t),q(t),k(t),h(t)),v(t))dt>0. 



te[0,t), 
v(t) = { v, t G [t,t + e), 
te[t + e, T] . 



For Vt> G U, we set 



Then we have 



/*+£ 
(fZ- w (t,y(t),y(*),z(t),Z(t), U (t),p(*),g(t),A;(t),/i(t)),t;)dt > 0. 
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Notice the fact that 

ct+e 



/t+e 
(H v (t,y(t),Y(t),z(t),Z(t),u(t),p(t),q(t),k(t),h(t)),u(t))dt = 0. 

Differentiating with respect to e at e = gives 



E 



E{H v (t,,y(t),Y(t),z(t),Z(t),u(t),p(t),q(t) : k(t),h(t)) : v-u(t)) > 0, 

a.e., a.s. t G [0,T] . 

The proof is completed. □ 

4 A sufficient maximum principle for optimal controls of 
forward- backward doubly stochastic control systems 

In this section, we investigate a sufficient maximum principle for the optimal control 
problem stated in Section 2. For simplicity of notations, we use the subscript label. 

Theorem 7. (Sufficient maximum principle,). Let (u t -,y t ,Y t , z t , Z^j be a quintuple 

and suppose there exist a solution {pt,qt,kt,h t ) of the corresponding adjoint forward- 

\ / 0<t<T 

backward doubly stochastic equation (3.2) such that for arbitrary admissible control v(-) G 
U a d, we have 

(kt,(Y t -Y^ dt< 00, (4.1) 



T 



2 



E / (p t AZ t -Z t \) dt< 00, (4.2) 



r 



E 



E J (ht,(Vt-Vt)) dt< 00, (4.3) 

E / (q t , (z t - z t )) 2 dt < 00, (4.4) 
Jo 

(^(Yt-Ytj ,H Z (t,y t ,Y t ,z t ,Z t ,u t ,p t ,q t ,k t ,h t ^ dt < 00, (4.5) 

(pt, (G(t,y t ,Y t ,z t ,Z t )-G(t,y t ,Y t ,z t ,Z t ^ dt < 00, (4.6) 

((?/t - j/t) (t,yt,Y t ,z t ,Z t ,u t ,p t ,q t ,k t ,ht^ dt < 00, (4.7) 

y (ft, (g(t,yt,Yt,Zt,Z t ) - g (t,y t ,Y t ,z t ,Z t ^^ dt < 00. (4.8) 



r-T 

E 
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Further, suppose that for allt G [0, T] , H \ t, y, Y, z, Z, v,p t , qt, k t , h t j is convex in (y, Y, z, Z, v) 
and 7 (Y) is convex in Y and $ is convex in y, moreover the following conditions holds 



E 



H (t,y t ,Y t ,Zt,Z t ,u t ,p t ,q t ,k t ,ht 



inf E 

veu 



H [t,y t ,Y t ,z t ,Z t ,v,p t ,q t ,k t ,h t 



(4.9) 



Then u t is an optimal control. 

Proof. Let (y t , Y t , z t , Z t , v t ) = {y < t\^ r t V \ z< t\ ^t^^tj be an arbitrary quintuple satisfying 
the control system (2.1). According to the definition of the cost function (2.2), we have 



J{v(-)) - J («(•)) = I (t, y t , Y t , z t , Z t , v t ) — I (t, y t , Y t , z t , Z t , u^j 



dt 



+E [$ (y T ) - $ (y T )} + E 
= I1+I2+I3, 



7 



(F ) - 7 (Yo) 



where 



Ii = E J l(t,y t ,Y t ,z t ,Z t ,v t ) - I (t,y t ,Y t ,z t ,Z t , 
h = E [$ (y T ) - $ {y T )\ , 



Ut 



dt, 



E 



7(^o) -7(^0 
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Now applying Ito's formula to (p t , Y t — Y t J + (q t , y t — y t ) on [0, T] , we get 
(p T , Y T - Y T ^ + (q T , y T - y T ) - (p , Y - F ) - (<Zo, Vo ~ Vo) 
= (% (y T ) , y T - yr) + (lv (*b) , Y - F ) 
= / ((z t - Z^j , (-H z (t,y t ,Y t ,z t ,Z t ,u t ,p t ,q t ,k t ,ht^^dt 

J 

fet, (G (t,y t ,Y t ,z t ,Z t ,v t ) - G (t,y t ,Y t , z t , Z t ,u t ^^ dt 
((z t - h) , (-H z (t,y t ,Y t ,z t , Z t ,u t ,p t ,q t ,k t ,ht^^ dt 
+ J (ht,(g(t,yt,Y t ,z t ,Z t ,v t ) - g (t,y t ,Y t ,z t ,Z t ,u t ^^dt 

(Yt-Y^dpt + J p t d (Y t - y t ) + J (y t -yt)dq t + J q t d(y t -y t ) 
J ((z t - Z^j , (-H z (t,y t ,Y t , z t , Z t ,u t ,p t ,q t ,k t ,h t ^^ dt 

k t , (g (t,y t ,Y t ,z t ,Z t ,v t ) - G (t, y t , Y t , z t , Z t , dt 
+ / - z t ) , (-H z (t,y t ,Y t ,z t ,Z t ,u t ,p t ,q t ,k t ,h t ^^dt 

(h t , (g (t,yt,Y t ,z t ,Z t ,v t ) - g (t,y t ,Y t , z t , Z t ,u t ^^ dt 
((Y t -Y t ^j , (-H Y (t,y t ,Y t ,z t , Z t ,u t ,p t ,q t ,k t ,h t ^^ dt 

+ 



Y t - Y^j , {-H z (t, y t , Y t , z t , Z t , u t ,p t , q t , h, h t ^ dW t 
~k t , (Yt - Yt) d%) 
(p t , (f (t,yt,Yt,Zt,Z t ,v t ) - F (t,y t ,Y t , z t , Z t ,u t ))^ dt 
- J (pt, (G (t, y t , Y t , z t , Z t , v t ) - G (t, y t , Y t , z t , Z t , v t )) d% 

+ J (p t , (z t - Z t ) dW t ) 

(yt-Vt), (-H y (t,yt,Yt,z t ,Zt,Ut,Pt,qt,h,h t ^ / )dt 
I ((yt~ yt) , (~H Z (t, y t , Y t , z^Z u u t ,pt, qt, h, ht)) d% 



r 



o 

+ 



+ f ((y t -yt),htdW t 
+ a* (fit. Vt. Y t , zt. Zt. Vt) — f (t, Vt. Yt. Zt. Zt. vu\\ dt 



where we claim that 



r-T 

= -E 



o 

[■T 

E 

k 

pT 

E 



Y T - Y T = <p (y T ) - tp (y T ) = y y (y (T)) (y (T) - y (T)) , 

yo - yo = x - x Q = o, 

Po = -TV (*o) , 

gr = $, (Kr)-¥» y (y(T))p(T). 

By Davis inequality, under the conditions (4.1)-(4.8), we can ensure that the stochastic 
integrals with respect to the Brownian motion have zero expectations. Moreover, by virtue 
of convexity of <3> and 7, it follows instantly that 

I 2 + I 3 = E [$ (y T ) - $ {y T )\ + E [7 (Y ) - 7 (^0) 

> E($,(y T ), ?/T -y T )+E(7 y (y ),y -Fo) 

Y t - Y^j , H Y (t, y t , Y t , z t , Z t , u t ,p t , qt, h, h^j ^ dt 

(pu (f (t,y t ,Y t ,z t ,Z t ,v t ) - F (t,y t ,Y t , z t , Z t ,u t ^^ dt 

" '(y t — y t ) ,H y (t,y t , Y t ,z t , Z t ,u f ,pt,q t , k t , h f ^dt 

(q~t, (9 (t,yt,Y t ,Zt,Z t ,v t ) - g (t,y t ,Y t , z t , Z t ,u t ^^ dt 

((z t - Z^j ,H Z (t,y t ,Y t ,z t ,Z t ,u t ,p t ,q t ,k t ,h t ^dt 

(k t , (G (t, y t , Y t , z t , Z t , v t ) - G (t, y t , Y t , ~z t , Z t , u^j ) ^ dt 

((z t - z t ) , H z (t, y t , Y t , z t , Z t , u t , p t , q t , h, h^j ^ dt 

E J (ht,(g(t,yt,Yt,Zt,Zt,Vt)-g(t,y t ,Yt,z t ,Zt,Ut^^dt 



— Ci + ^2 + ^3 + "4 + ^5 5 
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—1 



+E 



+E 



+E 



H Y (t, y t , Y t , z t , Z t , u t , p t , q t , k t , ^t) , (y - Y^j ^ dt 
(h z , (t, y t , Y t , zt, Z t , u t ,pt, qt, h, h^j , (z t - z t )^ dt 
H z (t, y t , Y t , z t , Z t , u t ,p t , q t , k t , h^j , (z t ~ Z^j ^ dt 



—2 



—3 



—4 



—5 



-E J (p t , F (t, y t , Y t , z t , Z t , v t ) - F [t, y t , Y t , z t , Z t , u t j J dt 

(fit, 9 (t, Vt, Yt, z t , Z t , v t ) - g (t, y t , Y t , z t , Z t , u^j ^ dt 
-E J (k t , G (t, y t , Y t , z t , Z t , v t ) - G (t, y t , Y t , z t , Z t , u^j ^ dt 
9 (t, Vt, Y t , z t , Z t , v t ) - g (t, y t , Y t , z t , Z t , u^j ^ dt. 



E^ (h t , 



dt 



the definition of H and I 1; we have 
= bJ I (t, y t , Y t , z t , Z t , v t ) — I (t, y t , Y t , z t , Z t , u^j 

T 

H (t, y t , Y t , z t , Z t , v t ,pt, qt, h, h^j - H (t, p t , Yt, z t , Z t , u t ,Pt, Qt, k 
qt, f (t, y t , Y t , z t , Z t , v t ) - f (t, y t , Y, z t , Z t , u^j ^ dt 
(pt, F (t, y t , Y t , z t , Z t , v t ) - F (t, y t , Y t , z t , Z t , ii t ] \] dt 



-- E 



-E 



+E 



J (k t , G (t, y t , Y t , z t , Z t , v t ) - G (t, y t , Y t , z t , Z t , i 
J (h t ,g{t,yt,Yt,z t ,Z t ,Vt) - g (t,y t ,Y t ,z t ,Z t ,u^ dt 



— 6 — — 2 — — 3 — — 4 — —5) 



E 



H [t,yt,Yt,z t ,Zt,Vt,pt,qt,kt,ht - H (t,y t ,Y t , z t , Z t ,u t ,p t , q t , k t , 
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On the one hand, by the virtue of convexity of H (t, y, Y, z, Z, v,p t , q t , k t , h^j with respect 
to (y, Y, z, Z, v) , we obtain 

H (t, y t , Y t , z t , Z t , vt,pt, qt, kt, htj ~ H (t, y t , Y t , z t , Z t , u t ,Pt, q t , k t , h^j 
> H y (t, y t , Y t , z t , Z t , u t ,Pt, q t , k t , h^j (y t - y t ) 
+H Y (t, y t , Y t , z t , Z t , u t ,Pt, qt, k t , ~h t ) (r t - y t ) 
+H Z (t, y t , Y t , z t , Z t , u t ,Pt, qt, h, h^j (z t - z t ) 
+H Z (t, y t , Y t , z t , Z t , u t ,pt, qt, h, h^j (z t - Z^j 
+H U (t, y t , Y t , z t , Z t , u t ,p t , q t , k, h^j (v t - u t ) 



(4.10) 



On the other hand, we know 



E 



H u (t, y t , Y t , z t , Z t , u t , vt, qt, h, h^j (v t - u*)] > 0. 



Consequently, associating with (4.10), we claim that 



—6 



E 



> E 



+E 



H [t, y t , Y t , z t , Z t , v t ,p t , q t , h, h t j - H [t, y t , Y t , z t , Z t , u t ,Pt, qt, h, K 
J H y (t, y t , Y t , z t , Z t , u t ,p t , q t , h, h^j (y t - y t ) dt 
J H Y (t, y t , Y t , z t , Z t , u t ,Pt, qt, h, h^j (Y t - Y^j dt 



dt 



E 



E J H z (t, y t , Y t , z t , Z t , u t ,p t , q t , h, h^j (z t - z t ) dt 
H z (t, y t , Y t , z t , Z t , u t ,Pt, qt, h, ~h t ^j (z t - Z^j dt 



Then, it follows that 



J M-))- J («(•)) = I1+I2+I3 

—Si + S 2 + S3 + S 4 + S 5 
> — C2 — ^3 — ^4 — "5 

— Ci + C2 + ^3 + "4 + "5 

= 0. 
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Since v (•) G U a d is arbitrary, we say that u (•) is an optimal control. The proof is completed. 

□ 



5 Applications to optimal control problems of stochastic 
partial differential equations 

In this section, we will give necessary and sufficient maximum principles for optimal 
control of SPDEs. Let us first give some notations from [14]. For convenience, all the 
variables in this section are one-dimensional. It is necessary to point out that all the results 
in this section can be extended to multi-dimensional cases, but we use the notations in 
general case. From now on C k (R; R) , C k b (R; R) , C k (R; R) will denote respectively the 
set of functions of class C k from R into R, the set of those functions of class C k whose partial 
derivatives of order less than or equal to k are bounded (and hence the function itself grows 
at most linearly at infinity), and the set of those functions of class C k which, together with 
all their partial derivatives of order less than or equal to k, grow at most like a polynomial 
function of the variable x at infinity. We consider the following quasilinear SPDEs with 
control variable: 



u (t, x) = if (x) + J t T [C"u (s, x) + F (s, x, u (s, x) , (Vita) (s, x, u) , v (s))] ds 
+ G (x, u (s, x) , (Vwcr) (s, x, u) , v (s)) dBs, < t < T, 



(5.1) 



where u : [0, T] x H d — > R fe and V« (s, x) denotes the first order derivative of u (s, x) with 
respect to x, and 

/ L V U! \ 

Cu = 



with 



1 » (J) (jC 



dxidxj 



i,j=l J i=l 

In this section, for simplicity, we also set d — k — 1, and 



dcj) (x) 
dxi 



f 
9 
F 
G 



RxRxR^R, 
RxRxR^R, 
[0,T]xRxRxRxR4R, 
[0,T]xRxRxRxR4R, 
R ->■ R. 



In order to assure the existence and uniqueness of solutions for (5.1) and (5.3) below, we 
jive the following assumptions for sake of completeness (see [14] for more details). 
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(Al) 

/ £ Cf b (R x R x R; R) , g £ (R x R x R; R) , 9? £ (R; R) , 
F(t,-,'-,-,v) 6 ^(R x R x R x R; R) , F(-,x,y,z,v) £ M 2 (0,T;R), 
G (i, •, •, •, v) £ Cf h (RxRxRxR;R), G (•, x, y, z, u) £ M 2 (0, T; R) , 
V* £ [0, T] , x £ R, y £ R, z £ R, u £ R. 

(A2) Assume that (HI), (H2) and (H3) hold. 

Let U a d be an admissible control set. The optimal control problem of SPDE (5.1) is to 
find an optimal control v* (■) £ U a d, such that 

J («*(•))= inf J MO), 
u(-)e« od 



where J (•) is the cost function as follows: 



J(«(-))=E 



/ (s, x, -u (s, x) , (Vug) (s, x, u (s, x)) , v (s)) 



ds + 7 (u (0, x)) 



(5.2) 

Here we assume I and 7 satisfy (H4) and X°' x (s) defined below. We can transform the 
optimal control problem of SPDE (5.1) into one of the following FBDSDE with control 
variable v (•): 

(s) =x + // / (X*> x (r) , Y t,x (r) ,v(r))dr + // g (X*> x (r) , Y*** (r) , v (r)) dV^, 
y*.* ( s ) = (p (X^ x (T)) + fj F (r, X*- 1 (r) , F*'* (r) , Z*> s (r) , v (r)) dr 
+ Jf G (r, X** (r) , Y l > x (r) , Z*> x (r) , u (r)) d%. 

- J T Z^ x (r)dW r , 0<t<s<T, 

(5.3) 

where (X t,x (•) , ^ t,:c (•) , Z t,x (•) , i> (•)) £ R x R x R x R, ar £ R. The corresponding optimal 
control problem of FBDSDEs (5.3) is to find an optimal control v* (•) £ U a d, such that 

J («•(•))= inf J («(•)), 

«(-)eWad 

where J (t> (•)) is the cost function the same as (5.2): 



J (v (•)) = ■£ 



f I (s, X (s) ,Y(s),Z(s),v (s)) ds + 1 (Y (0)) 
Jo 



Now we consider the following adjoint FBDSDEs involving the four unknown processes 
(p(t),q(t),k(t),h(t)): 

' dp (t) = (Fy P (t) + Gyk (t) - fyq (t) - Qyh (t) - ly) dt 

+ (F zP (t) - G z k (t) - l z ) dW t -k (t) d%, 
dq (t) = (F x p (t) - f x q (t) + G x k (t) - g x h (t) - l x ) dt + h (t) dW t , 
[p(0) = - lY (Y(0)), q(T) = -<p x (X(T))p(T), < t < T. 
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It is easy to see that (5.4) satisfies (HI), (H2) and (H'3), so it is uniquely solvable by virtue 
of Proposition 2. Therefore we know that (5.4) has a unique solution (p (•) ,q(-),k(-),h (•)) G 
M 2 (0, T; R x R x R x R). Define the Hamilton function as follows: 

H (t, X,Y, Z,v,p, q, k, h) = H (t, X,Y,0, Z,v,p, q, k, h) 

= I (t, X,Y,Z,v) -k-G (t, X, Y, Z, v) 

+q-f(X,Y,v)-p-F(t,X,Y,Z,v) + h-g(X,Y,v). 

(5.5) 

We now formulate a maximum principle for the optimal control system of (5.3). 

Theorem 8. Suppose (Al)-(A2) hold. Let (X (•) , Y (•) , Z (•) , v* (•)) be an optimal control 
and its corresponding trajectory of (5.3), (p (•) , q (•) , k (•) , h (•)) be the solution of (5.4)- 
Then the maximum principle holds, that is, for t G [0, T], Vi> G U, 

(H (t, X(t),Y (t) ,Z(t), v* (t) ,p(t),q(t),k (t) , h (t)) ,v-v*(t))>0, a. e., a.s. . 

Proof. By Theorem 6 in Section 3, we get the desired result. □ 

For relationship between (5.1) and (5.3), we have 

Lemma 9. For any given admissible control v (•) , we assume (Al) and (A2) hold. Then 
(5.3) has a unique solution (X f ' x (•) , Y f ' x (•) , Z f ' x (•)) G M 2 (0, T; R x R x R) . 

Lemma 10. For any given admissible control v (•) , we assume (Al) and (A2) hold. Let 
{u (t, x) ; < t < T,x G R} be a random field such that u (t, x) is Tfrp-measurable for each 
(t,x) , u G C ' 2 ([0,T] x R;R) a.s., and u satisfies SPDE (5.1). Thenu(t,x) = Y l ' x (t) . 

Lemma 11. For any given admissible control v (•) , we assume (Al) and (A2) hold. Then 
{u (t, x) = Y t,x (t);0<KT,x6 R} is a unique classical solution of SPDE (5.1). 

The proofs are classical, we omit it. Now set the Hamilton function as follows: 

H (t,x,u,Vua,v,p,q,k,h) = I (t, x,u,Vua,v) — k ■ G {t,x,u,Vua,v) 

+q ■ f (x,u,v) — p ■ F (£, x, u, Vua, v) + h ■ g (x, u, v) . 

We can state the maximum principle for the optimal control problem of SPDE (5.1). 

Theorem 12. (Necessary maximum principle^) Suppose u(t,x) is the optimal solution 
of SPDE (5.1) corresponding to the optimal control v* (■) of (5.1). Then we have, for any 
v G U and t G [0, T] , x G R, 

( K H V (t, x, u (t, x) , (Vwa) (t, x) , v* (t) ,p(t) ,q(t) ,k (t) , h (t)) , v — v* (t)) > 0, a.e., a.s. 

Proof. By virtue of lemma 9,10,11, the optimal control problem of SPDE (5.1) can be trans- 
formed into the one of FBDSDE (5.3). Hence, from Theorem 8, the desired result is easily 
obtained. □ 
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Next we apply our sufficient maximum principle to get the following result. 

Theorem 13. (Sufficient maximum principle j For\/t G [0, T] , let v — v (t) G U a d with 
corresponding solution u (t, x) of (5.1) and let (^X (t) ,Y (t) , Z (t) ,v (t)j be quadruple and 

(p (t) i Q (t) ) k (t) , h (t) j be a solution of the associated adjoint FBDSDEs (5.3) and (5.4), 

respectively. Assume that H (t, X, Y, Z, v, p(t),q (t) ,k(t),h (t)) is convex in (X, Y, Z, v) , 
and 7 (Y) is convex in Y , moreover the following condition holds 

E [S (t, X(t),Y (t) ,Z(t),v(t), P (t) ,q(t),k(t),h (t)J 

= inf E \H (t, X (t) , Y (t) , Z (t) , v, p (t) ,q(t),k(t),h (t) ) . 
veil L \ / . 

Then v (t) is an optimal control for the problem (5.2). 

Proof. Noting the above assumptions, by Theorem 7, it is easy to get desired result. □ 

Remark 14. In [12], Bernt 0ksendal proved a sufficient maximum principle for the optimal 
control of system described by a quasilinear stochastic heat equation, that is 



dY (t, x 



[LY (t, x) + b (t, x, Y (t, x) , v (t))} dt 
+a (t, x, Y (t, x) , v 

(t,x) e [0,T]xG. 



(5.6) 

Y(0,x) = £(x); xeG (5.7) 
Y (t, x) = T) (t, x) ; (t, x) E (0, T) x dG. (5.8) 
Here G is an open set in R n with C 1 boundary dG and 

n B 2 n 3 

L<j> (x) = J2 % (*) g~^<l> + I> (*) ^ <P e C 2 (R n ) 

i,j=i 1 i i=i * 

where a(x) = [o-ij {x)] l<i - <n is a given symmetric definite symmetric nx n matrix with 

entries a„ (x) G C 2 (G) n C (G) for alii, j — 1, 2, • • • , n and b { (x) G C 2 (G) n C (G) for all 
i,j — 1, 2, • • • , n. It is worth to pointing out that our method to get the sufficient maximum 
principle is completely different from his, and the most important thing is that in our SPDEs, 
the coefficients of the elliptic operator contain control variables and Y (for more information 
see Theorem 2.1-Theorem 2.3 in [12]). 
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6 Applications 



We now illustrate the results of Section 3 by looking at some examples. Theoretically, the 
maximum principles presented in Section 3 and Section 4 characterizes the optimal control 
through some necessary and sufficient conditions. However, it is not immediately feasible to 
implement such principles directly, partially due to the difficulty of computing fully coupled 
forward-backward doubly stochastic system. In this section, we give two special examples 
and show how to explicitly solve them using our maximum principle. 



6.1 Example 1 

We provide a concrete example of forward-backward doubly stochastic LQ problems and 
give the explicit optimal control and validate our major theoretical results in Theorem 6. 
(Necessary maximum principle). First let the control domain be U = [—1,1]. Consider 
the following linear forward-backward doubly stochastic control system. We assume that 

dy (t) = (z (t) -Z(t)+v (t)) dW t - z [t) d%, 

dY (t) = -(z(t) + Z (t) + v (<)) d% + Z (t) dW u (6-1) 
y(0) =0, Y(T) = 0, te[0,T], 

where T > is a given constant and the cost function is 

J( V (.)) = \v£ (y 2 (t) + Y 2 (t) + z 2 (t) + Z 2 (t)+v 2 (t))dt 
+±EY 2 (0) + ±Ey 2 (T) . 

(6.2) 

Note that (6.1) are linear control system. According to the existence and uniqueness of (6.1), 
it is straightforward to know the optimal control is u (•) = 0, with the optimal state trajectory 
(y(t) ,Y (t) ,z(t) ,Z(t)) = 0, t e [0,T] . Notice that the adjoint equation associated with 
the optimal quadruple (y (t) ,Y (t) , z (t) , Z (t)) = are 

dp (t) = -Y (t) dt + (-k (t) -h(t)-Z (t)) dW t -k (t) d%, 
dq (t) = -y (t) dt + (-k (t) -h(t)-z (t)) d% + h it) dW^, (6-3) 
p(0) = 0, q(T) = 0, te[0,T\. 



26 



Obviously, (p (t) ,q(t) ,k(t) ,h (t)) = is the unique solution of (6.3). Instantly, we give the 
Hamiltonian function is 

H (t, y(t),Y (t) ,z(t),Z (t) ,v,p(t),q (t) ,k(t),h (*)) 

= \ (y 2 (t) + y 2 (t) + z 2 (t) + z 2 (t) + v 2 ) 

-k(t) (z (t) + Z (t) + v) 
+h(t) (z (t)-Z(t)+v) 

1 2 
= -V . 

2 

It is clear that, for any d6W, we always have 

E(H v (t,y(t),Y(t),z(t),Z(t),u(t), P (t),q(t),k(t),h(t)),v-u(t)) = 0. 

6.2 Example 2 

In this subsection we will provide a special optimal control of SPDEs by Theorem 13. 
(Sufficient maximum principle). We now introduce some notations. For any random vari- 
able F of the form F — f (W (h) ,...W (h n ) ; B (h) ,...B (k p )) with / G C b °° (R n+P ) , 
h u . . . h n e L 2 ([0, T] , R d ) , hi, . . . k p G L 2 ([0, T] , R l ) , where 



W(hi) 



hi(t)dW t , B(hi)= [ ki(t)dB t , 



we let 



D t F = J2fUW(h 1 ),...W(h n );B(k 1 ),...B(k p ))h l (t), < t < T. 



i=i 



For such an F, we define its 1,2-norm as: 



\F\\is= ' E 



F 2 + / |A^| 2 dt 
Jo 



S denotes the set of random variable of the above form. We define the Sobolev space: 

The "derivation operator" D. extends as an operator from D 1 ' 2 into L 2 (Q; L 2 ([0, T] , R n )) . 

Now we modify the stochastic reaction-diffusion equation considered in [12] which can 
be described the density of a population at time t G [0, T] and at the point x G R as follows. 



u(t,x) = x + [v 2 (s) A u (s, x) + u (s, x) + Vw (s, x) t> (s)] ds 

rT 



+ // n(s,x)d£, < t < T, 
27 



(6.4) 



and x G R, v G U a d- The two Brownian motions W and B are one-dimensional. Suppose we 
want to minimize the following performance criterion 



J (v) = E 



ds + u (0, x) 



L/o 7 

where 7 > 1. In this case the Hamiltonian gets the form 

H(t,X,Y,Z,v,p,q,k,h) 
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k (Y + Z) - pY + hv. 



Obviously, it is convex in (Y, Z, v) . The corresponding FBDSDEs are 

X f ' x (s) = x + J t S v(r) dwl, 
Y l > x (s) = X f ' x (T) + fj (Y l ' x (r) + Z f ' x (r)) dr 

+ fj y (r) d£ - fj Z*^ (r) dw£ , < t < s < T, 

It is easy to obtain the solutions of (6.5) are 

y*' x (5) = E [X** (T) exp {Wy -Wt + Br- B S }\F S ] . 

Besides, the adjoint processes are 

dp (s) = (p (s) + k (s)) ds + jo (t) dV^ - k (s) dB~ s , 
dq(s) = h(s) dW*s, 

p(t) = -l, q(T) = -p(T), t<s<T. 

The solutions of (6.7) are 

p(s) = E[-exp{W s + W t + B s -B t }\F s ], 

q(s) = E[-p(T)\^], 

h(s) = D s q(s), a.e., < t < s < T. 



The function 



v — > H (t, X,Y, Z,v,p, q, k, h) 

= kY - pY + hv. 

7 



is minimum when 

where h (t) are given by (6.8). 
Acknowledgments. . 



v(t) = (h(t))~ , 0<t<T. 



(6.5) 



(6.6) 



(6.7) 



(6i 
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